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ABSTRACT 



This booklet presents the Reading Framework for the 1992, 
1994, 1998, and 2000 National Assessments of Educational Progress (NAEP), 
adopted by the National Assessment Governing Board (NAGB) . The Framework 
contains the rationale for the aspects of reading assessed and criteria for 
development of the assessment. Developed through a national consensus process 
as part of an effort to move assessment forward, the framework presented in 
the booklet is more consistent with contemporary knowledge about reading and 
more relevant to the needs of education decisionmakers than earlier 
assessments have been. After an overview and introduction, chapters of the 
booklet are: (1) development of the Reading Framework (which discusses 

Steering Committee guidelines, the nature of assessment, reading literacy, 
assessment and instruction, new methodologies, and the basis of the 
Framework) ; (2) design of the Reading Framework (which discusses a goal for 

reading literacy education; constructing, extending, and examining meaning; 
and constructing the assessment) ; and (3) special Studies and Background 
Information (which discusses the oral reading and response study, the 
portfolio study, the metacognition study, and information for education 
policymakers) . Contains 10 references; appendixes present reading achievement 
level descriptions, lists of Steering and Planning Committee members, and 
sample items. (RS) 
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What Is NAEP? 



T he National Assessment of Educational Progress (NAEP) is a 
congressionally mandated project of the U.S. Department of 
Education s National Center for Education Statistics. It assesses 
what U.S. students should know and be able to do in geography, 
reading, writing, mathematics, science, U.S. history, the arts, civics, 
and other academic subjects. Since 1969, NAEP has surveyed the 
achievement of students at ages 9, 13, and 17 and, since the 1980s, 
in grades 4, 8, and 12. 

Measuring educational achievement trends over time is critical to 
measuring progress toward the National Education Goals. 



The National Assessment Governing Board 

The National Assessment Governing Board (NAGB) was created by 
Congress to formulate policy for NAEP. Among the Board's responsi- 
bilities are developing objectives and test specifications and designing 
the assessment methodology for NAEP. 
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Overview 



T his document presents the Reading Framework for the 1992, 
1994, 1998, and 2000 National Assessments of Educational 
Progress (NAEP), adopted by the National Assessment 
Governing Board (NAGB). The Framework contains the rationale 
for the aspects of reading assessed and criteria for development of 
the assessment. The NAEP in Reading uses a variety of assessment 
approaches, both conventional and innovative. Developed through a 
national consensus process as part of an effort to move assessment 
forward, the new NAEP in Reading is more consistent with con- 
temporary knowledge about reading and more relevant to the needs 
of educational decisionmakers than earlier assessments were. The 
new reading assessment has the following characteristics: 

• It examines students’ abilities to construct, extend, and 
examine the meaning of what they read through the use of 
items that elicit a variety of responses to both multiple-choice 
and open-ended tasks. 

• It assesses student performance in different reading situa- 
tions — reading for literary experience, reading to be informed, 
and reading to perform a task — by using authentic, “real-life” 
texts. Students in grades 8 and 12 are permitted to choose 
from among different short stories. 

• It includes special studies to examine other aspects of reading, 
including the reading fluency of students and their reading 
habits and practices. 
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Introduction 



R eading is the most important, fundamental ability taught in 
the nation’s schools. It is vital to society and to the people 
within it. It is the door to knowledge and a capability that can 
liberate people both intellectually and personally. 

For 30 years the National Assessment of Educational Progress 
(NAEP) has been reporting the reading achievement of students in 
the United States. Known in recent years as The Nation’s Report 
Card, NAEP reports provide descriptive information about student 
strengths and weaknesses in reading and a number of other sub- 
jects. The reports provide data that compare groups of students by 
race and ethnicity, gender, type of community, and region, as well 
as data that chart trends in achievement over time. Relationships 
between student achievement and school-related experiences such 
as homework and instruction are also reported. 

A significant change occurred in 1990 in how and for whom 
NAEP results are reported. The 1990 NAEP mathematics assess- 
ment collected information on a trial basis to provide “state report 
cards” that allow state-to-nation and state-to-state comparisons. In 
1992 the NAEP reading assessment included state-level reporting 
of fourth-grade results on a trial basis. Reading was assessed again 
in 1994 at the national level, and at the state level in grade four. In 
1998 NAEP assessed reading in grades four and eight at the state 
level. 

The decision to undertake state-by-state reporting of assessment 
data had its beginnings in 1984 when a majority of chief state 
school officers supported the development of an assessment system 
that would provide state-level information. In the following year, 
that group supported the expansion of NAEP as the most feasible 
vehicle for such an assessment system. In 1986 Georgia and 
Wyoming contracted with NAEP to conduct in-state assessments 
concurrently with the national assessment and to provide them with 
state-to-nation comparison data. In 1986 and 1987, several groups 
of southern states contracted with NAEP to conduct state-level 
assessments in mathematics. This effort was coordinated by the 
Southern Regional Education Board. 
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During this period, the governors of various other states ex- 
pressed a desire to obtain information from NAEP on the educa- 
tional achievement of students in their states. In 1987 a national 
study group chaired by Lamar Alexander, then governor of Tennes- 
see, made a series of recommendations about the future of NAEP. 
One of the most significant was that the assessment be expanded to 
provide state-by-state reporting. 

In 1988 Congress passed the Hawkins-Stafford Elementary and 
Secondary School Improvement Amendments (P.L. 100-297), 
which added a new dimension to NAEP: a voluntary trial state 
assessment in 1990 and 1992. The first trial was conducted in 
spring 1990, with 40 states and territories participating in a math- 
ematics assessment at grade eight. The trial continued in 1992 with 
mathematics assessments at grades four and eight and a reading 
assessment at grade four. In 1994 NAEP state-level assessments 
were given in reading at grade four. NAEP conducted a state-level 
reading assessment in grades four and eight in 1998. 

The decision to undertake state-by-state reporting is not without 
its critics, especially among reading educators. Some fear that state- 
by-state comparisons will be used to draw inappropriate inferences 
or to make unsupported cause-and-effect relationships. Others are 
concerned that the assessment design will not reflect appropriate 
educational goals. Still others fear that the various NAEP assess- 
ments will foster, and ultimately outline, a national curriculum. 
Reading educators in particular were apprehensive that the reading 
assessment would be insensitive to many theoretical and instruc- 
tional developments in the field and that it might oversimplify the 
complex set of behaviors that are integral to reading. 

The first report card related to America’s national education 
goals was released in fall 1991. It contained many gaps, especially 
at the state level. Reading information was limited to what could 
be inferred from Scholastic Aptitude Test scores. There is clearly 
a need for an assessment that will allow states to determine the 
success with which they have met the goals established by the 
President and the nation’s governors. The NAEP in Reading fills 
a critical gap in this area. 
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Chapter One 



Development of the 
Reading Framework 

T he Reading Framework for the National Assessment of 
Educational Progress (NAEP) contains the rationale for the 
aspects of reading to be assessed and criteria for development 
of the assessment. The national consensus process used to 
develop this Framework was guided by the following: 

• A general pattern of consensus development, which was set 
forth by law and which has evolved over time, that calls for 
“active participation of teachers, curriculum specialists, 
subject matter specialists, local school administrators, parents, 
and members of the general public” (P. L. 100-297, Part C, 
1988). 

• The decision that the reading assessment would pilot state- 
by-state comparisons, which increased the importance of the 
consensus process. 

• Recognition that experts, educators, and interest groups in 
reading often hold diverse and conflicting views that have not 
been completely clarified, much less settled, by research in 
the field. 

The process of developing the Framework was carried out in late 
1989 and early 1990 under the direction of the National Assess- 
ment Governing Board (NAGB). Created by Congress under P.L. 
100-297, NAGB is responsible for formulating policy for NAEP. 
The Board is specifically charged with selecting subject areas to be 
assessed, developing assessment objectives and test specifications 
by use of a national consensus approach, identifying appropriate 
achievement goals for each age and grade, and other NAEP policy 
responsibilities. 

To prepare the new Reading Framework, NAGB awarded a 
contract to the Council of Chief State School Officers (CCSSO). 
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The consensus process involved a steering committee, a planning 
committee, and CCSSO project staff. The following describes the 
composition of each of these groups and outlines the roles each 
played. 

• The steering committee consisted of members representing 
16 national organizations (see appendix B). This group met 
initially in October 1989 to provide guidance for the consen- 
sus process and met two additional times to respond to the 
progress of the work on the Framework and offer guidance. 
Drafts of each version of the developing Framework were sent 
to members of this committee for review and reaction. 

• The 15-member planning committee consisted of experts in 
reading, including several university professors, the dean of a 
college of education, a classroom teacher, a school adminis- 
trator, state-level specialists in reading and assessment, and a 
representative of the business community (see appendix B). 
This committee was established to identify the goals for the 
assessment and prepare the Framework. It met with the 
steering committee early in the project and three subsequent 
times as it developed the plan for the new reading assessment. 
A subgroup of this committee met in January 1990 to develop 
the specifications for the assessment. 

• CCSSO project staff included a director, a project coordinator, 
and a project associate (see appendix B). In addition to 
meeting with the steering committee and the planning com- 
mittee, this group maintained regular contact with NAGB staff 
and Board members. 

As the Framework was being developed, CCSSO project staff 
continually sought guidance and reaction from a wide range of 
people in the fields of reading and assessment, from school teachers 
and administrators to state coordinators of reading and reading 
assessment. After thorough discussion and some amendment, 

NAGB adopted the recommended Framework in March 1990. 
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Steering Committee Guidelines 

At its first meeting, the steering committee established guide- 
lines to be followed in developing the Framework: 

• Focus on outcomes or be performance oriented, rather than 
reflect a specific instructional or theoretical approach. The 
Framework should not focus on the specific reading skills that 
lead to outcomes but on the outcomes themselves. 

• Address the increasing reading literacy needed for employ- 
ability, personal development, and citizenship. 

• Expand the range of assessment tools to include such tech- 
niques as open-ended questions and other new approaches 
and formats appropriate to the objectives. 

• Account for contemporary research on reading and literacy 
without implying a departure from the primary focus on 
outcomes. 

• Provide information to policymakers and educators that will 
assist them in making decisions about the improvement of 
educational performance. 

• Include general statements about what is reasonable reading 
performance for 4th-, 8th-, and 12th-grade students. 

Considerations and Principles 

The development of this Framework for the NAEP in Reading 
was guided by several considerations and principles — some result- 
ing from the nature and purpose of the assessment, others reflecting 
the thinking and values of the planning committee and the steering 
committee. 

The Nature of Assessment 

The NAEP in Reading is an assessment conducted on a represen- 
tative sample basis, not a test of individual performance. It is 
designed to inform policymakers and the public about educational 
achievement in the United States in broad terms. It is not designed 
to diagnose the causes of problems in individual students, schools, 
or districts. Although analysis of NAEP data can direct and inform 
research, the assessment is not designed primarily as a research 
instrument. 
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NAEP data in reading can be used to inform participating states 
of some of the strengths and weaknesses of their students’ perfor- 
mance. The data can also be used to inform individual states and 
the country as a whole of some of the links among reading-related 
activities in schools, student and teacher background characteris- 
tics, and performance in certain aspects of reading. 

Reading Literacy 

The term reading literacy is not intended to imply only basic or 
functional literacy. Rather the term connotes a broader sense of 
reading, including knowing when to read, how to read, and how to 
reflect on what has been read. Contemporary research indicates that 
reading is a complex process that involves an interaction among the 
reader, the text, and the context in which something is read. Be- 
cause reading is not considered to be a simple, unidimensional skill, 
reading achievement cannot be represented adequately by a single 
score. Whereas some aspects of reading, such as how well a reader 
summarizes a passage, can be measured directly, other aspects, 
such as how a reader utilizes reading strategies, can be measured 
only indirectly. 

Assessment and Instruction 

Assessment alone should not drive instruction. Educators, in 
response to societal expectations, should set goals or standards that 
assessments can measure and serve. However, teachers often do use 
assessment tasks to set priorities for what they teach. With this in 
mind, the planning committee determined that the NAEP in Read- 
ing must contain passages and tasks so similar to those that students 
encounter in classrooms and in their own reading that, should 
teachers choose to do so, they could use the kinds of passages and 
tasks found on the assessment to set priorities in their classrooms 
without distorting instmction. 

New Methodologies 

A consensus of societal goals and values, the best available 
reading theory and research, and the wisdom gained from class- 
room experience — but not primarily traditional psychometric 
theory — should drive the design of the assessment. The Reading 
Framework must not promote assessment items that in terms of 
correlating with reading ability, have only statistical utility, but do 



not correspond to sound concepts of reading or resemble desirable 
classroom activities. Although the aspects of reading that can be 
measured in a project of national scope are limited by available 
resources, development time, and methodology, every effort must 
be exerted to make the best use of available methodologies and 
resources. Assessment capabilities must be driven forward so that 
important aspects of reading that now elude measurement can be 
addressed in the near future. Toward these ends, new types of items 
and new methods of analysis were used for the NAEP in Reading, 
along with well-constructed, multiple-choice items. 

The Basis of the Framework 

Because the 1992, 1994, and 1998 reading assessments include 
reporting of state-level results, concerns about the strength of the 
assessment design and about how the results will be reported have 
increased. (In 2000, reading will be tested at the national level in 
grade 4.) Aware of these concerns, the planning committee at- 
tempted to develop a Framework that provides for an assessment 
that reflects both professional consensus and the best technical 
design possible in a large-scale reading assessment. The committee 
was aware that the Framework should represent a broad concept 
of reading that reflects the views of contemporary research, yet 
recognizes those aspects of reading currently emphasized in local 
school districts. It also should recognize that a variety of ap- 
proaches and programs can produce successful readers. Therefore, 
in preparing this Framework, the committee considered a variety 
of perspectives, emphases, and opinions among professionals in 
universities and in state and local school districts. They began their 
work by identifying the most important goal of reading literacy 
education. 
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Chapter Two 



Design of the Reading Framework 



A Goal for Reading Literacy Education 

I f reading literacy includes knowing when to read, how to 
read, and how to reflect on what has been read, then an 
obvious goal of reading literacy education is to develop good 
readers. Substantial research and classroom experience have 
provided a great deal of information about good readers. In general, 
good readers have positive attitudes about reading and positive 
self-perceptions of themselves as readers. They choose to read a 
variety of materials, recognizing that reading serves many purposes 
in their lives. They read often and have developed their own criteria 
for what makes a text enjoyable or useful. They function success- 
fully in schools, homes, and workplaces. They attain personal 
satisfaction that can come only from reading. 

Some characteristics of good readers that distinguish them from 
less proficient readers follow. Good readers: 

• Possess positive habits and attitudes about reading. 

• Read with enough fluency that they can focus on the meaning 
of what they read. 

• Use what they already know to understand what they read. 

• Form an understanding of what they read and extend, elabo- 
rate on, and critically judge its meaning. 

• Use a variety of effective strategies to aid their understanding 
and to plan, manage, and check the progress of their reading. 

• Read a wide variety of texts and read for different purposes. 

The planning committee proposed that these characteristics of 
good readers provide the reference points for decisions about which 
aspects of reading would be assessed in NAEP. This orientation 
toward good readers reflects a focus on performance rather than a 
focus on instructional approaches to reading. In line with this 
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orientation, the planning committee determined that the major focus 
of the new NAEP in Reading would be an assessment of student 
performance that uses three types of reading situations and involves 
several ways that students can construct, extend, and examine the 
meaning of what they are reading. The assessment gathers informa- 
tion about other important aspects of how students read, including 
fluency, use of different strategies to aid understanding, and the 
kinds of reading they engage in both in and out of the classroom. 
The next sections focus on these features of the assessment. 

Types of Reading Situations 

Reading for meaning involves a dynamic, complex interaction 
among three elements: the reader, the text, and the context. The 
context of a reading situation includes the purposes for reading that 
the reader might use in building a meaning of the text. The graphic 
below illustrates the reader-text-context interaction. 




Good readers bring to this interaction their prior knowledge 
about the topic of the text and their purposes for reading it, as well 
as their skill in reading, which includes their knowledge about the 
reading process and about the structure of texts. Different types of 
texts have different organizations and features that have an effect 
on how a reader reads them. Readers are oriented to a given text 
very differently, depending on the text itself and on their purposes 
for reading. Some readers are comfortable and successful when 
reading stories but are uncomfortable and unsuccessful when 
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reading directions for assembling a bicycle. Some readers may have 
learned how to read and learn from textbooks but are less able to 
approach and appreciate a poem. Because students can be more or 
less proficient in reading different types of texts and in adopting 
different purposes for reading, it seems evident that the assessment 
of their performance must involve different types of text and 
different purposes for reading. 

The NAEP reflects these considerations by assessing three 
general types of text and reading situations: 

• Literature: Reading for literary experience. 

• Information: Reading to be informed. 

• Documents: Reading to perform a task. 

The following discussion examines important characteristics of 
these situations. 

Reading for literary experience usually involves the reading 
of novels, short stories, poems, plays, and essays. In these reading 
situations, readers explore the human condition and consider 
interplays among events, emotions, and possibilities. In reading for 
literary experience, readers are guided by what and how an author 
might write in a specific genre and by their expectations of how the 
text will be organized. The readers’ orientation when reading for 
literary experience usually involves looking for how the author 
explores or uncovers experiences and engaging in vicarious experi- 
ences through the text. 

Reading to be informed usually involves the reading of articles 
in magazines and newspapers, chapters in textbooks, entries in 
encyclopedias and catalogues, and books on particular topics. The 
type of prose found in such texts has its own features and readers 
need to be aware of those features to understand it. For example, 
depending on what they are reading, readers need to know the rules 
of literary criticism, historical sequences of cause and effect, or 
scientific taxonomies. Readers read to be informed for different 
purposes; for example, to find specific pieces of information when 
preparing a research project or to get some general information 
when glancing through a magazine article. These purposes call for 
different orientations to text from those used in reading for literary 
experience because readers are specifically focused on acquiring 
information. 
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Reading to perform a task usually involves the reading of 
documents such as bus or train schedules; directions for games, 
repairs, or classroom or laboratory procedures; tax or insurance 
forms; recipes; voter registration materials; maps; referenda; 
consumer warranties; or office memos. When they read to perform 
tasks, readers must use their expectations of the purpose and 
structure of documents to guide how they select, understand, and 
apply information. The readers’ orientation in these tasks involves 
looking for specific information in order to do something. Readers 
need to be able to apply the information, not simply understand it, 
as is usually the case in reading to be informed. Readers engaging 
in this type of reading are not likely to savor the style or thought in 
these texts, as they might in reading for literary experience. 

Scales 

The reading situations described above form the basis of the 
development of scales by which the NAEP in Reading is reported. 
Performance on the literary, informational, and task-performing 
components are reported on separate scales. 

The proportion of items related to each reading situation changes 
from grade to grade to reflect the changing demands made of 
students as they mature. The proportions of items at each grade 
level are shown below. 



Grade 


Literary 

Experience 


To Be 
Informed 


To Perform 
a Task 


4 


55% 


45% 


(No Scale) 


8 


40% 


40% 


20% 


12 


35% 


45% 


20% 



At the fourth-grade level, reading to perform a task will not be 
reported as a scale but rather as descriptive results. This decision 
was the result of three considerations: 



• To construct a scale in reading to perform a task, approxi- 
mately one-fifth (20 percent) of the total items in the fourth- 
grade assessment would need to be devoted to those items. 

• Reading to perform a task, while important, probably does not 
reflect one-fifth of the type of independent reading fourth 
graders usually do. 
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• By decreasing the number of items for reading to perform a 
task, more assessment time can be devoted to having students 
respond through extended writing to open-ended questions 
about longer, authentic texts. 

The proportions of items in the 8th- and 12th-grade assessments 
are meant to reflect the reading that 8th graders and 12th graders 
are doing. 

Though literature is still very important for these students, they 
read extensively for information in content areas such as social 
studies and science, for information related to hobbies and interests, 
and for job-related purposes. 

These scales support the need for teachers of science, civics, 
health, business, and technology — as well as literature — to under- 
stand the importance of skilled reading in their content areas and to 
promote the types of reading necessary to perform well in their 
classrooms. 

Constructing, Extending, and Examining Meaning 

Readers respond to a given text in a variety of ways as they use 
background knowledge and information from the text to construct 
an initial understanding, develop an interpretation to extend the 
text’s meaning, and examine the meaning so as to respond person- 
ally and critically to the text. These various interactions between 
readers and text do not form a sequential hierarchy or a set of 
subskills. Rather, they should be in the repertoire of readers who 
are at every developmental level in reading. An understanding of 
these interactions was crucial in the development of the assessment. 

Forming an Initial Understanding 

Forming an initial understanding requires readers to provide an 
initial impression or global understanding of what they have read. It 
involves considering the text as a whole or in a broad perspective. 

In the assessment, the first question following the passage taps this 
aspect of reading. Questions on initial understanding might include: 

• Write a paragraph telling what the story/poem is about. 

• Which of the following is the best statement of the theme of 
this story? 
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• Write a paragraph telling what this article generally tells you. 

• What is this text supposed to help you do? 

• What would you tell someone about the main character? 

Developing an Interpretation 

Developing an interpretation requires readers to extend their initial 
impressions to develop a more complete understanding of what they 
have read. It involves linking information across parts of a text as 
well as focusing on specific information. Questions that ask readers 
to develop their interpretation might include the following: 

• How did the plot begin to develop? 

• What caused the character to ? Use examples 

from the story to support your answer. 

• What caused this event? 

• What type of person is this character? Use information from 
the text to support your answer. 

• In what ways are these ideas important to the topic or theme? 

• What will be the result of this step in the directions? 

• What does this character think about ? 

Personal Reflection and Response 

Personal reflection and response require readers to connect 
knowledge from the text with their own general background 
knowledge. Questions that ask readers to reflect and respond might 
include: 

• How did this character change your ideas about 

? 

• Do you think that (a grandmother and a 

5 -year-old) would interpret this passage the same way? 
Explain. 

• What current event does this remind you of? Explain. 

• Does this description fit what you know about 
? Why? 

• What does this passage/story say to you? 
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• Why do you think (bullfrogs eat dragonflies)? 

Is there anything else you think (they might 

eat)? What parts of the passage, information from other books, 
or your own knowledge helped you answer this? 

Demonstrating a Critical Stance 

Demonstrating a critical stance requires readers to stand apart 
from the text and consider it objectively. It involves a range of tasks 
including critical evaluation; comparing and contrasting; and 
understanding the impact of such features as irony, humor, and 
organization. Questions asking readers to demonstrate a critical 
stance might include the following: 

• Compare this article/story to that one. 

• How useful would this be for ? Why? 

• Do you agree with the author’s opinion of this event? 

• Does the author use (irony, personification, 

humor) effectively? Explain. 

• What could be added to improve the author’s argument? 

Why? 

• Is this information needed? 

• What other information would you need to find out? 

The assessment also contains some questions that require readers 
to make connections across parts of a text or between texts. For 
example, students might be asked to compare a poem and a story 
with the same theme or to relate information from a first-person 
account to a textbook description of an event. 

The following table illustrates the interactions among the aspects 
of reading assessed in the 1992-2000 NAEP. 
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Constructing the Assessment 



Designing Items 

To effectively and efficiently explore students’ abilities to 
construct, examine, and extend meaning in a text, a combination 
of open-ended and multiple-choice items is used in the assessment. 
The type of items — multiple-choice or open-ended — is determined 
by the nature of the task. 

The Board supported the inclusion of many open-ended items 
for a number of reasons. The first has to do with the nature of 
reading. As they read, readers are involved in a number of pro- . 
cesses, including integrating information from the text with their 
own background knowledge, reorganizing ideas, and analyzing 
and critically considering the text. In an assessment of reading, it 
is important to have items that can directly and accurately reflect 
how readers use these processes. Open-ended items that require 
extended responses provide a means of examining whether students 
can generate their own organized and carefully thought out re- 
sponses to what they have read. Multiple-choice items do not 
permit this kind of assessment. Furthermore, open-ended items 
more closely resemble the real-world reading tasks that students 
must be able to perform to succeed both in and out of school. 
Open-ended items are the trend in state and international assess- 
ment programs. It is important that NAEP participate in such 
developments. 

Multiple-choice items are used where the nature of the task calls 
for a single, clear answer to a question. Multiple-choice questions 
emphasize critical thinking and reasoning rather than factual recall. 

Open-ended items are scored using primary-trait scoring, with 
scoring rubrics created for each question. Primary-trait scoring rates 
how well a reader accomplishes a task according to a few major 
criteria. The rubrics guide the scoring by giving specific criteria for 
assigning a number score to levels of success in answering the 
question. (See appendix C for passages and rubrics.) 

To ensure that only important questions (those that will reveal 
how readers construct an understanding or extend and examine the 
meaning of the text) are used, the assessment passages were ana- 
lyzed, using an approach such as mapping essential text elements, 
before the questions were developed. This analysis helped the test 
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developers to determine if a given passage has a coherent, orderly 
structure and is rich enough in meaning to provide several items 
useful for examining student performance. 

The first question following a selection taps the student’s initial 
understanding of the passage. Questions requiring a more devel- 
oped understanding or further examination of the meaning of the 
passage follow. Some questions require readers to integrate or 
compare information across more than one passage. 

Selecting Passages 

Passages selected for the assessment were drawn from authentic 
texts actually found and used by students in everyday reading. 
Whole stories, articles, or sections of textbooks were used, rather 
than excerpts or abridgements. Passages written solely for a test or 
to provide drill in a specific skill were not considered appropriate 
for this assessment. 

Does the use of authentic passages give some students an unfair 
advantage because of their familiarity with the texts? Two safe- 
guards protect against this. First, passages are not drawn from 
classroom basal readers, but are taken from books and magazines 
students are unlikely to have read. For example, some passages 
might be taken from magazines published in 1990 or earlier. The 
second safeguard is the nature of the items. They require students 
to engage in careful inspection and consideration of the passages 
so that even in the unlikely event that a student has read a given 
passage, she or he would need to reread and reconsider it to 
respond to the items. 

The difficulty of items is a function of the difficulty of the 
passages and of the amount of background knowledge a reader 
must use from outside the text itself to answer them. Because of 
their limitations, conventional readability estimates were not the 
only or even the main criteria for determining the difficulty level 
of a passage. The difficulty of text was judged by its length, the 
complexity of its arguments, the abstractness of its concepts, and 
the inclusion of unusual points of view and shifting time frames — 
factors that are not addressed by traditional readability measures. 
As the difficulty of the passages increases, so does the difficulty of 
the questions, because the questions focus on important points in 
the text. 
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Texts range in difficulty from those that specific grade-level 
teachers agree could be read by the least proficient students in a 
class (for example, about grade two in a fourth-grade class) to those 
texts that can be read by only the most proficient readers in the 
class (possibly grade eight level in a fourth-grade class). 

In general, the assessment consists of items that most students at 
the given grade levels can do. This means not only that students 
possess the requisite abilities, but that they are likely to have 
encountered the particular type of text or task. 

Achievement Levels 

NAEP achievement levels describe what students should know 
and be able to do at grades 4, 8, and 12. 

The new reading assessments were constructed with these levels 
in mind to ensure congruence between the levels and the test 
content. See appendix A for the Reading Achievement Level 
Descriptions. 
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Chapter Three 



Special Studies and Background 
Information 



Special Studies 

R eading is a complex process that is being understood better as 
it is studied over time. Time constraints and the large numbers 
of students involved in the NAEP in Reading limit what is 
included in the assessment. The assessment does not represent 
completely all aspects of the reading process that are supported 
by current reading theory and research. The planning committee, 
however, believed in the importance of addressing as many facets 
of reading as possible and in acknowledging new and promising 
approaches to reading assessment. For these reasons, the commit- 
tees proposed conducting special studies. These studies focus on 
three important aspects of reading: fluency, reading habits and 
practices, and metacognition. Two of these — an oral reading and 
response study and a gathering of portfolio-like samples of class- 
room reading activities — are combined into the Integrated Reading 
Performance Record (IRPR). The third is a study of the metacog- 
nitive strategies students use to comprehend what they read. The 
IRPR was part of the 1992 assessment, using a sample of fourth- 
grade students in the national assessment. 

Oral Reading and Response Study 

Part of the IRPR, the oral reading and response study, addresses 
concerns that fourth graders may not have the ability to recognize 
or figure out words as they read. Because the study focuses on 
actual reading performance, it also explores the potential of NAEP 
to be based more on student performance. 

The importance of reading fluency goes beyond individual word 
recognition or accurate oral reading. Reading fluency involves the 
efficient, automatic recognition of words, which permits readers to 
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attend to understanding and thinking about what they are reading. 
Even the most tentative beginning readers can, at many levels, 
understand some of what they read. Fluent readers, however, 
possess facility with written language that makes it possible for 
them to devote sufficient attention to understanding the text’s 
meaning rather than only identifying the written words. The fluency 
with which readers can use all of the cues in a text, including 
syntax, semantics, and phonics, contributes to the effectiveness 
with which they understand what they read. In this sense, fluency 
is one means to some important ends. 

In the assessment, fluency is determined by an analysis of 
fourth-grade students’ oral reading of a passage from the assess- 
ment. The oral reading of a passage was chosen as the vehicle for 
assessing fluency because passage reading is observable and, as 
opposed to the reading of isolated words, allows students to 
strategically use their full range of text-processing skills. 

Students are asked to read orally and respond to a passage they 
have read silently and answered questions about as a part of the 
regular assessment. An analysis is made of their oral reading 
fluency by looking for evidence of their use of phonics, sight 
vocabulary, semantics, and language structure. The relation of 
fluency to comprehension is also examined. The students’ oral 
responses are related to their written responses to the passage. 
Because individual readers are asked to respond orally to the same 
questions they responded to in writing on the main assessment, 
examination of whether responses are similar in both modes is 
possible. It permits a consideration of the degree to which perfor- 
mance on the open-ended written questions might be confounded 
with students’ writing abilities. 

The purpose of the fourth-grade oral reading study is to pilot and 
refine the methodology and determine the usefulness of the results. 
A decision can then be made about whether to include examination 
of oral fluency on future assessments and possibly to extend it to 
other grade levels. 

Portfolio Study 

Portfolio assessment has engaged the interest of practitioners 
and policymakers as a means of documenting literacy perfor- 
mance in the day-to-day context of classroom life. Some portfolio 
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components are included in the IRPR, but the set of components is 
modest and does not represent a complete portfolio. However, 
given the high level of interest in this approach to literacy assess- 
ment and the potential value of such an approach, it is deemed 
important to gather some data that might inform future assessment 
efforts. 

The two main purposes of the portfolio study are to gather and 
analyze examples of classroom work in reading and to interview 
students about their reading activities both in and out of school. 
Components of the study include samples of students’ daily work 
such as worksheets, written summaries, flow charts, or answers to 
open-ended questions. These samples are chosen by teachers, with 
student participation, and are analyzed to indicate the types of 
activities teachers are actually using in classrooms and how well 
students demonstrate in their daily work the types and aspects of 
reading examined in the assessment. Interviews with students about 
their reading of self-selected books provide some information about 
student reading habits and practices. 
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The portfolio component study can become an important part of 
NAEP because it opens a window on the classroom. Such a study is 
valuable because it: 

• Provides information on students’ self-selected reading 
outside of school and how their responses to whole books 
compare with responses to passages on the actual assessment. 

• Offers some information about what is actually happening in 
classrooms during reading instruction. 

• Permits examination of the types of reading responses 
students make on a daily basis. 

• Begins to involve teachers directly in the assessment, rather 
than just in the usual question-and-answer section of a 
background questionnaire. 

• Permits large-scale exploration of an approach to assessment 
that is gaining support in states and districts throughout the 
country. 

Metacognition Study 

The term metacognition is used to describe the knowledge and 
strategies that good readers use to monitor their comprehension 
such as predicting, skimming, and rereading. Research has shown 
that good readers are strategic. They know about and select strate- 
gies and approaches to their reading, and they use these strategies 
and approaches to help them understand and check their success in 
accomplishing their purposes for reading. Research has provided a 
number of insights into what good readers specifically do before, 
during, and after reading. 

Before reading, good readers consider what the text is going to 
be about, what they already know about the topic and the text 
genre, how fast or slowly they need to read, and what specifically 
they are looking for as they read. While reading, good readers ask 
themselves many questions: Does the meaning they are developing 
make sense? What might come next? Are they using the right 
speed? Are they using the right background information? What 
might they do to understand better? After reading, good readers 
decide if they have successfully read the text, whether they should 
go back and examine specific parts of the text, or whether they 
should reread for different purposes using a different strategy. 




31 26 



Throughout the reading process, good readers’ decisions about 
which strategies to apply are guided by an understanding of the 
purposes and structures of different types of text and by a 
knowledge of how to construct and examine meaning. 

How students use strategies for monitoring their understanding 
and knowledge about reading is being considered in a separate 
but related study. The main purpose of the study is to determine 
efficient and reliable means of assessing students’ awareness and 
use of reading strategies. The study will examine the usefulness of 
different formats, such as written or oral responses and multiple- 
choice or open-ended items. It also weighs the effectiveness of 
certain specific questions such as: 

• How did you read the passage above? (Fast, slowly, skimmed 
it, carefully?) Explain why. 

• What especially helped you understand this part of the 
passage? 

• What would help you answer/do this? 

• What do you think will come next? 

• Was there a place where you stopped to reread? Underline it 
in the passage. 

The study, planned for a future assessment, will provide infor- 
mation about students’ awareness and use of reading strategies that 
can be reported along with the results of the main reading 
assessment. 

Information for Education Policymakers 

Information useful to education policymakers is obtained from 
student questionnaires that are part of the NAEP in Reading and 
from questionnaires to which teachers and principals respond. The 
data gathered from these questionnaires, as well as those gathered 
in the portfolio study, give additional information about reading 
instruction in American schools and about the reading habits and 
practices of students. Some of this information focuses on topics 
that policymakers can address, such as access to a library at school 
or availability of a variety of reading materials in classrooms. 
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In summary, the NAEP in Reading represents a collaborative 
effort among educational agencies, educators, and those interested 
in education to provide relevant and valid information about how 
well American students read and about factors affecting their 
performance. To this end, the Framework includes the best ap- 
proaches possible at this time for gathering information on reading 
performance and activities related to becoming good readers. The 
assessment is designed to endorse high standards for student 
achievement and set forth realistic goals for effective reading 
literacy in the 21st century. The assessment seeks to advance both 
reading and its assessment while pointing the way for continued 
progress in the future. 
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Appendix A 

Reading Achievement Level Descriptions 
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NAEP Reading Achievement Levels 



Grade 4 
Basic 

Fourth-grade students performing at the basic level should demon- 
strate an understanding of the overall meaning of what they read. 
When reading text appropriate for fourth graders, they should be 
able to make relatively obvious connections between the text and 
their own experiences, and extend the ideas in the text by making 
simple inferences. 

For example, when reading literary text, they should be able to tell 
what the story is generally about — providing details to support their 
understanding — and be able to connect aspects of the stories to their 
own experiences. 

When reading informational text, basic-level fourth graders should 
be able to tell what the selection is generally about or identify the 
purpose for reading it, provide details to support their understand- 
ing, and connect ideas from the text to their background knowledge 
and experiences. 

Proficient 

Fourth-grade students performing at the proficient level should be 
able to demonstrate an overall understanding of the text, providing 
inferential as well as literal information. When reading text appro- 
priate to fourth grade, they should be able to extend the ideas in 
the text by making inferences, drawing conclusions, and making 
connections to their own experiences. The connections between 
the text and what the student infers should be clear. 

For example, when reading literary text, proficient-level fourth 
graders should be able to summarize the story, draw conclusions 
about the characters or plot, and recognize relationships such as 
cause and effect. 

When reading informational text, proficient-level students should 
be able to summarize the information and identify the author’s 
intent or purpose. They should be able to draw reasonable conclu- 
sions from the text, recognize relationships such as a cause and 
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effect or similarities and differences, and identify the meaning of 
the selection’s key concepts. 

Advanced 

Fourth-grade students performing at the advanced level should 
be able to generalize about topics in the reading selection and 
demonstrate an awareness of how authors compose and use literary 
devices. When reading text appropriate to fourth grade, they should 
be able to judge texts critically and, in general, give thorough 
answers that indicate careful thought. 

For example, when reading literary text, advanced-level students 
should be able to make generalizations about the point of the story 
and extend its meaning by integrating personal experiences and 
other readings with ideas suggested by the text. They should be able 
to identify literary devices such as figurative language. 

When reading informational text, advanced-level fourth graders 
should be able to explain the author’s intent by using supporting 
material from the text. They should be able to make critical 
judgments of the form and content of the text and explain their 
judgments clearly. 

Grade 8 
Basic 

Eighth-grade students performing at the basic level should demon- 
strate a literal understanding of what they read and be able to make 
some interpretations. When reading text appropriate to eighth 
grade, they should be able to identify specific aspects of the text 
that reflect the overall meaning, extend the ideas in the text by 
making simple inferences, recognize and relate interpretations and 
connections among ideas in the text to personal experience, and 
draw conclusions based on the text. 

For example, when reading literary text, basic-level eighth graders 
should be able to identify themes and make inferences and logical 
predictions about aspects such as plot and characters. 

When reading informational text, they should be able to identify 
the main idea and the author’s purpose. They should make infer- 
ences and draw conclusions supported by information in the text. 
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They should recognize the relationships among the facts, ideas, 
events, and concepts of the text (e.g., cause and effect, order). 

When reading practical text, they should be able to identify the 
main purpose and make predictions about the relatively obvious 
outcomes of procedures in the text. 

Proficient 

Eighth-grade students performing ait the proficient level should be 
able to show an overall understanding of the text, including infer- 
ential as well as literal information. When reading text appropriate 
to eighth grade, they should be able to extend the ideas in the text 
by making clear inferences from it, by drawing conclusions, and by 
making connections to their own experiences — including other 
reading experiences. Proficient eighth graders should be able to 
identify some of the devices authors use in composing text. 

For example, when reading literary text, students at the proficient 
level should be able to give details and examples to support themes 
that they identify. They should be able to use implied as well as 
explicit information in articulating themes; to interpret the actions, 
behaviors, and motives of characters; and to identify the use of 
literary devices such as personification and foreshadowing. 

When reading informational text, they should be able to summa- 
rize the text using explicit and implied information and support 
conclusions with inferences based on the text. 

When reading practical text, proficient-level students should be 
able to describe its purpose and support their views with examples 
and details. They should be able to judge the importance of certain 
steps and procedures. 

Advanced 

Eighth-grade students performing at the advanced level should be 
able to describe the more abstract themes and ideas of the overall 
text. When reading text appropriate to eighth grade, they should be 
able to analyze both meaning and form and support their analyses 
explicitly with examples from the text; they should be able to 
extend text information by relating it to their experiences and to 
world events. At this level, student responses should be thorough, 
thoughtful, and extensive. 
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For example, when reading literary text, advanced-level eighth 
graders should be able to make complex, abstract summaries and 
theme statements. They should be able to describe the interactions 
of various literary elements (i.e., setting, plot, characters, and 
theme); to explain how the use of literary devices affects both the 
meaning of the text and their response to the author’s style. They 
should be able critically to analyze and evaluate the composition 
of the text. 

When reading informational text, they should be able to analyze 
the author’s purpose and point of view. They should be able to use 
cultural and historical background information to develop perspec- 
tives on the text and be able to apply text information to broad 
issues and world situations. 

When reading practical text, advanced-level students should be 
able to synthesize information that will guide their performance, 
apply text information to new situations, and critique the usefulness 
of the form and content. 

Grade 12 
Basic 

Twelfth-grade students performing at the basic level should be able 
to demonstrate an overall understanding and make some interpreta- 
tions of the text. When reading text appropriate to 12th grade, they 
should be able to identify and relate aspects of the text by making 
simple inferences, recognize interpretations, make connections 
among and relate ideas in the text to their personal experiences, 
and draw conclusions. They should be able to identify elements of 
an author’s style. 

For example, when reading literary text, basic-level 12th graders 
should be able to explain the theme, support their conclusions with 
information from the text, and make connections between aspects 
of the text and their own experiences. 

When reading informational text, basic-level 12th graders should 
be able to explain the main idea or purpose of a selection and use 
text information to support a conclusion or make a point. They 
should be able to make logical connections between the ideas in 
the text and their own background knowledge. 
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When reading practical text, they should be able to explain its 
purpose and the significance of specific details or steps. 

Proficient 

Twelfth-grade students performing at the proficient level should be 
able to show an overall understanding of the text, which includes 
inferential as well as literal information. When reading text appro- 
priate to 12th grade, they should be able to extend the ideas of the 
text by making inferences, drawing conclusions, and making 
connections to their own personal experiences and other readings. 
Connections between inferences and the text should be clear, even 
when implicit. These students should be able to analyze the 
author’s use of literary devices. 

When reading literary text, proficient-level 12th graders should be 
able to integrate their personal experiences with ideas in the text to 
draw and support conclusions. They should be able to explain the 
author’s use of literary devices such as irony and symbolism. 

When reading informative text, they should be able to apply text 
information appropriately to specific situations and integrate their 
background information with ideas in the text to draw and support 
conclusions. 

When reading practical text, they should be able to apply informa- 
tion or directions appropriately. They should be able to use personal 
experiences to evaluate the usefulness of text information. 

Advanced 

Twelfth-grade students performing at the advanced level should be 
able to describe more abstract themes and ideas in the overall text. 
When reading text appropriate to 12th grade, they should be able to 
analyze both the meaning and the form of the text and explicitly 
support their analyses with specific examples from the text. They 
should be able to extend the information from the text by relating 
it to their experiences and to the world. Their responses should be 
thorough, thoughtful, and extensive. 

For example, when reading literary text, advanced-level 12th 
graders should be able to produce complex, abstract summaries and 
theme statements. They should be able to use cultural, historical, 




37 



40 



and personal information to develop and explain text perspectives 
and conclusions. They should be able to evaluate the text, applying 
knowledge gained from other texts. 

When reading informational text, they should be able to analyze, 
synthesize, and evaluate points of view. They should be able to 
identify the relationship between the author’s stance and elements 
of the text. They should be able to apply text information to new 
situations and to the process of forming new responses to problems 
or issues. 

When reading practical text, advanced-level 12th graders should 
be able to make critical evaluations of the usefulness of the text and 
apply directions from the text to new situations. 
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Appendix C 

Sample Items 




Grade 4 — Reading for Information 



Amanda Clement: 
The Umpire in a Skirt 

by Marilyn Kratz 



It was a hot Sunday afternoon in Hawarden, a small town in 
western Iowa. 

Amanda Clement was sixteen years old. She sat quietly in the 
grandstand with her mother, but she imagined herself right out there 
on the baseball diamond with the players. Back home in Hudson, 
South Dakota, her brother Hank and his friends often asked her to 
umpire games. Sometimes she was even allowed to play first base. 

Today, Mandy, as she was called, could only sit and watch Hank 
pitch for Renville against Hawarden. The year was 1904, and girls 
were not supposed to participate in sports, But when the umpire for 
the preliminary game between two local teams didn’t arrive, Hank 
asked Mandy to make the calls. 

Mrs. Clement didn’t want her daughter to umpire a public event, 
but at last Hank and Mandy persuaded her to give her consent. 
Mandy eagerly took her position behind the pitcher’s mound. 
Because only one umpire was used in those days, she had to call 
plays on the four bases as well as strikes and balls. 

Mandy was five feet ten inches tall and looked very impressive 
as she accurately called the plays. She did so well that the players 
for the big game asked her to umpire for them — with pay! 

Mrs. Clement was shocked at that idea. But Mandy finally 
persuaded her mother to allow her to do it. Amanda Clement 
became the first paid woman baseball umpire on record. 

Mandy’s fame spread quickly. Before long, she was umpiring 
games in North and South Dakota, Iowa, Minnesota, and Nebraska. 
Flyers sent out to announce upcoming games called Mandy the 
“World Champion Woman Umpire.” Her uniform was a long blue 
skirt, a black necktie, and a white blouse with UMPS stenciled 
across the front. Mandy kept her long dark hair tucked inside a 
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peaked cap. She commanded respect and attention — players never 
said, “Kill the umpire!” They argued more politely, asking, “Beg 
your pardon, Miss Umpire, but wasn’t that one a bit high?” 

Mandy is recognized in the Baseball Hall of Fame in Coopers- 
town, New York; the Women’s Sports Hall of Fame; and the 
Women’s Sports Foundation in San Francisco, California. In 1912 
she held the world record for a woman throwing a baseball: 279 
feet. 

Mandy ’s earnings for her work as an umpire came in especially 
handy. She put herself through college and became a teacher and 
coach, organizing teams and encouraging athletes wherever she 
lived. Mandy died in 1971. People who knew her remember her for 
her work as an umpire, teacher, and coach, and because she loved 
helping people as much as she loved sports. 



“Amanda Clement: The Umpire in a Skirt,” by Marilyn Kratz. 
Copyright 1987 by Marilyn Kratz. 

Copyright 1987 by Cars Corporation. 

Reprinted with permission. 
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“Amanda Clement: The Umpire in a Skirt” 
Sample Questions — Grade 4 



1. This passage is mostly about how Mandy 

a. had an unusual career in baseball.* 

b. convinced her mother to like baseball. 

c. put herself through college. 

d. wore the first umpire’s uniform. 

2. What obstacle did Mandy overcome in her baseball career? 

a. The players did not respect her. 

b. Baseball was not popular in Iowa. 

c. Girls did not typically take part in sports.* 

d. She did not have very much experience at baseball. 

3. Write a paragraph explaining how Mandy got her first 
chance to be an umpire at a public game. 

4. Which statement is supported by information in the passage? 

a. Players never argued with Mandy during a game. 

b. Mrs. Clement liked to watch Mandy play baseball. 

c. Mandy was athletic and loved baseball.* 

d. Mandy started the Women’s Sports Hall of Fame. 

5. If she were alive today, what question would you like to ask 
Mandy about her career? Explain why the answer to your 
question would be important to know. 

* Denotes correct answer. 
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6. Tell two ways in which Mandy’s experience would be similar 
or different if she were a young girl wanting to take part in 
sports today. 

7. Which event came first in Mandy’s career? 

a. Mandy was paid to umpire a game. 

b. Mandy was recognized in the Baseball Hall of Fame. 

c. Mandy became a teacher and coach. 

d. Mandy umpired games for her brother and his friends.* 

8. Give three examples showing that Mandy was not a quitter. 

9. The information in the passage is presented mainly by 

a. comparing Mandy to other umpires. 

b. discussing important events in Mandy’s life.* 

c. describing the game of baseball. 

d. providing details about life in the early 1900s. 

10. What was Hank’s role in Mandy’s early career? 



*Denotes correct answer. _ _ 
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“Amanda Clement: The Umpire in a Skirt” 
Scoring Criteria — Grade 4 



3. Write a paragraph explaining how Mandy got her first 
chance to be an umpire at a public game. 

Acceptable answers indicate that the umpire for a preliminary 
game between two local teams did not show up for the game 
and/or Mandy ’s brother suggested that she do the job. 



5. If she were alive today, what question would you like to ask 
Mandy about her career? Explain why the answer to your 
question would be important to know. 

Unsatisfactory — These responses demonstrate little or no 
understanding by providing isolated bits of information or by 
posing a question that is unrelated to Mandy ’s experience as a 
woman in a career traditionally dominated by males. In some 
cases, students refer to a line from the text and recast it in the 
form of a question. 

Partial — These responses demonstrate some understanding of 
the information in the article by posing at least one question 
that is either not explained or is explained using circular 
reasoning. 

Essential — These responses demonstrate some understanding 
of the information in the article. They contain at least one 
question that is specifically related to Mandy’s career with an 
explanation that is relevant to furthering the student’s own 
understanding of how it might feel to be an athlete who is 
highly successful or the first person to do something. 

Extensive — These responses contain one question that is 
explained in relation to the student’s personal view of the 
passage and that indicates that the student considered the more 
abstract aspects of the passage. These responses contain quest- 
ions that are about issues or reactions and that grow out of 
careful consideration of the potential problems Mandy faced 
and the historical context in which she lived. 
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6. Tell two ways in which Mandy’s experience would be 

similar or different if she were a young girl wanting to take 
part in sports today. 

Acceptable responses mention areas of similarity or difference 
in relating Mandy’s experience as an umpire to today’s sports 
environment (such as less stigma attached to girls participating 
in sports now; there is more than one umpire at a baseball game 
today). 

8. Give three examples showing that Mandy was not a quitter. 

Acceptable answers mention three events from the passage that 
reflect positively on Mandy and that demonstrate some deter- 
mination in her character. 



10. What was Hank’s role in Mandy’s early career? 

Acceptable responses discuss the fact that Hank let Mandy play 
ball and umpire or that he recommended her for the umpire 
position. 



Note: These scoring criteria are a summary of the more extensive guides used in 
the NAEP scoring. The full guides include examples of student responses for each 
score point. 
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Grade 8 — Reading to Perform a Task 



Bus Schedule 



AA4 EAST TRENTON 
hi 111 TRENTON RAIL 
1 / 1/7 STATION 



(formerly L Line) 

Serving: Trenton 

East Trenton 
Trenton Rail Station 
Labor & Industry Bldg. 
Justice Complex 
Hamilton 



Effective: January 6, 1990 




Information 1 (800) 772-2222 
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FLASH A PASS 

NJ TRANSIT offers a variety of bus passes. For one dis- 
counted monthly price you can travel an unlimited number of 
times within the zone range indicated on your pass. Your pass 
is valid on all NJ TRANSIT or NJT-subsidized routes (except 
320 — Lincoln Tunnel Park & Ride; 321 — Vince Lombardi 
Park & Ride; 322 — Meadowlands Park & Ride; and 302 — NJ 
TRANSIT Newark Airlink) and selected private carriers. 
You’ll never need a transfer or have to carry exact change 
again. The following passes are available: 

• Interstate Bus Pass — New Jersey to New York. 

• Intrastate Bus Card — For travel on local lines 
within New Jersey. 

• Intra-Commuter Pass — For commuter travel via 
Routes 9 and 18 to Newark or Jersey City. 

Available at outlets throughout the State or by mail direct 
from: NJ TRANSIT, Mail-Fare, P.O. Box 180, Maplewood, 
NJ 07040. Toll-free 1-800-648-0215. Write or call for more 
information and an order form. 

Ticket Agents 

NJ TRANSIT Mercer Inc. 

1132 East State Street 

Trenton, NJ 08608 1-609-396-9171 

NJ TRANSIT Rail Station 
72 South Clinton Avenue 
Trenton, NJ 08609 

EDDIE’S DONUTS 
508 Hamilton Avenue 

Trenton, NJ 08608 1-609-392-4456 

FUJI’S MARKET 
4 North Broad Street 

Trenton, NJ 08608 1-609-393-1115 

Feeder Fare 

NJ TRANSIT rail passengers displaying their monthly rail 
pass to an NJ TRANSIT bus driver can get a reduced fare for 
a ride to or from a rail station. 
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To Trenton Rail Station 



Weekdays 

Including the 
following Holidays 

Lincoln's Birthday 
Veterans’ Day 



HAMILTON 
Goodall Rubber 


EAST TRENTON 
Mulberry & Enterprise 


TRENTON 
Stale & Warren 


TRENTON 

Justice Complex 




TRENTON 
R.R. Station 


A.M. 


A.M. 


A.M. 


A.M. 


A.M. 


W - 


5.55 


6.08 


6.12 


6.17 


W - 


6.25 


6.38 


6.42 


6.47 


W 6.55 


7.00 


7.13 


7.17 


7.22 


W - 


7.25 


7.38 


7.42 


7.47 


w - 


7.55 


8.08 


8.12 


8.17 


w - 


8.25 


8.38 


8.42 


8.47 


w - 


9.25 


9.38 


9.42 


9.47 


w - 


10.25 


10.38 


10.42 


10.47 


w - 


11.25 


11.38 


11.42 


11.47 


w - 


P.M. 


P.M. 


P.M. 


P.M. 


w - 


12.25 


12.38 


12.42 


12.47 


w - 


1.25 


1.38 


1.42 


1.47 


w - 


2.25 


» 2.38 


2.42 


2.47 


w - 


3.25 


i 3.38 


3.42 


! 3.47 


P.M. 


- 


- 


- 


- 


W 3.50 


3.55 


i 4.08 


4.12 


! 4.17 


w - 


4.25 


i 4.38 


4.42 


! 4.47 


w - 


4.55 


; 5.08 


5.12 


► 5.17 


w - 


5.25 


; 5.38 


5.42 


I 5.47 


w - 


5.55 


; 6.08 


6.12 


> 6.17 
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NO SERVICE will be operated on Sundays 
or the following Holidays: New Year's Day, 
Memorial Day. Independence Day. Labor 
Day, Thanksgiving Day and Christmas Day. 




Saturdays 

Including the 
following Holidays 

Martin Luther King Jr. Day 
Presidents' Day 
Good Friday 
Columbus Day 
Election Day 



EAST TRENTON 
Mulberry & Enterprise 


TRENTON 
State & Warren 


TRENTON 
R.R. Station 


A.M. 


A.M. 


A.M. 


W 6.25 


6.38 


6.45 


W 7.25 


7.38 


7.45 


W 8.25 


8.38 


8.45 


W 9.25 


9.38 


9.45 


W10.25 


10.38 


10.45 


W11.25 


11.38 


11.45 


P.M. 


P.M. 


P.M. 


W 12.25 


12.38 


12.45 


W 1.25 


1.38 


1.45 


W 2.25 


2.38 


2.45 


W 3.25 


3.38 


3.45 


W 4.25 


4.38 


4.45 


W 5.25 


5.38 


5.45 


W 6.25 


6.38 


6.45 
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Notice to Wheelchair Passengers 6- 

Passengers requiring the use of wheelchair lift are 
encouraged to telephone 24 hours in advance to 
notify NJ TRANSIT of the trip they wish to take. 
Please call 1 (800) 582-5946 between 6:00 a m. and 
10:00 p.m. Only those trips identified with a "W" 
can be requested. 






To East Trenton 



Weekdays 

including the 
following Holidays 

Lincoln’s Birthday 
Veterans' Day 



TRENTON 

R.R. Station 


TRENTON 
Justice Complex 


TRENTON 
Hanover & Broad 


EAST TRENTON 
Mulberry & Enterprise 


HAMILTON 
Goodall Rubber 


A.M. 


A.M. 


A.M. 


A.M. 


A.M. 


W 6.25 


6.30 


6.35 


6.48 


6.53 


W 7.00 


7.05 


7.10 


7.23 


- 


W 7.30 


7.35 


7.40 


7.53 


- 


W 8.00 


8.05 


8.10 


8.23 


- 


W 8.30 


8.35 


8.40 


- 


- 


W 9.00 


9.05 


9.10 


9.23 


- 


W 10.00 


10.05 


10.10 


10.23 


- 


W11.00 


11.05 


11.10 


11.23 


- 


P.M. 


P.M. 


P.M. 


P.M. 


P.M. 


W 12.00 


12.05 


12.10 


12.23 


- 


W 1.00 


1.05 


1.10 


1.23 


- 


W 2.00 


2.05 


2.10 


2.23 


- 


W 3.00 


3.05 


3.10 


3.23 


- 


W 4.00 


4.05 


4.10 


4.23 


- 


W 4.30 


4.35 


4.40 


4.53 


- 


W 5.00 


5.05 


5.10 


5.23 


1 


W 5.30 


5.35 


5.40 


5.53 


l 


W 6.00 


6.05 


6.10 


i 6.23 


- 


W 6.30 


6.35 


6.40 


6.53 


- 
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NO SERVICE will be operated on Sundays 
or the following Holidays: New Year’s Day, 
Memorial Day. Independence Day, Labor 
Day, Thanksgiving Day and Christmas Day. 








Saturdays 

including the 
following Holidays 

Martin Luther King Jr. Day 
Presidents’ Day 
Good Friday 
Columbus Day 
Election Day 



TRENTON 
R.R. Station 


TRENTON 
Hanover & Broad 


EAST TRENTON 
Mulberry & Enterprise 


A.M. 


A.M. 


A.M. 


W 7.00 


7.08 


7.21 


W 8.00 


8.08 


8.21 


W 9.00 


9.08 


9.21 


W10.00 


10.08 


10.21 


W11.00 


11.08 


11.21 


P.M. 


P.M. 


P.M. 


W12.00 


12.08 


12.21 


W 1.00 


1.08 


1.21 


W 2.00 


2.08 


2.21 


W 3.00 


3.08 


3.21 


W 4.00 


4.08 


4.21 


W 5.00 


5.08 


5.21 


W 6.00 


6.08 


6.21 
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Notice to Wheelchair Passengers 

Passengers requiring the use of wheelchair lift are 
encouraged to telephone 24 hours in advance to 
notify NJ TRANSIT of the trip they wish to take. 
Please call 1 (800} 582-5046 between 6:00 a m. and 
10:00 p.m. Only those trips identified with a m W* 
can be requested. 
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NJ TRANSIT 
Customer Services 



If you have a compliment or complaint regarding our service or 
employees, please call Customer Service Monday through Friday, 
8 a.m. to 6 p.m. 

In New Jersey 1-800-772-3606 

Out of State 1-201-935-2500 

How To Use This Schedule 

1. Select day of week desired. 

2. Locate direction of travel desired. 

3. Locate time checkpoint or alternate destination 
nearest you. 

4. Locate time desired under checkpoint. 

5. Check meaning of footnotes, if applicable. 

6. Check bus destination sign before boarding. 

Transit Information 
(6 a.m. to 12 a.m. daily) 

Telephone numbers for bus, train, and fares information 

Northern New Jersey 1-800-772-2222 

Southern New Jersey 1-800-582-5946 

Out of State 1-201-460-8444 

* Hearing Impaired 1-800-772-2287 

*(TTD/TTY: 6 a.m. to 12 a.m. daily) 

Prohibited on Buses 

1. Smoking of any kind. 

2. Eating food and drinking beverages. 

3. Littering. 

4. Loud playing of radios. 




Exact Fare Line 

Passengers are required to have exact fare in coins no larger than 
a quarter when boarding buses on this line. Drivers do not carry 
money and cannot make change. 
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Bus Schedule 

Sample Questions — Grade 8 



Before answering any questions, take a few minutes to familiarize 
yourself with the bus schedule. 

As you answer the questions about the bus schedule, make notes in 
the margins of the bus schedule about ways it might be improved to 
make it easier to use. 



1. The schedule is organized from top to bottom according to 

a. time of departure.* 

b. geographic location of the stop. 

c. length of the bus ride. 

d. alphabetical order of the destination. 

2. Explain the most likely reason for scheduling only one bus 
each way between the Goodall Rubber plant and the 
railroad station. 

3. What is the meaning of the “W” in the left margin of each 
line of the schedule? 

a. Weekday service only. 

b. Wheelchair lift.* 

c. West side of the railroad station. 

d. Wednesday service only. 

4. On Friday, the ride from the railroad station to the inter 
section of Hanover and Broad takes 10 minutes. On 
Saturday it takes 8 minutes. Why do the schedules differ? 



* Denotes correct answer. 
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5. Lois wants to use the wheelchair lift. What telephone 
number should she call to arrange this? 

a. 201-935-2500 

b. 1-800-772-3606 

c. 1-800-772-2287 

d. 1-800-582-5946* 

6. How long does it take to ride from the intersection of 
Hanover and Broad to the intersection of Mulberry and 
Enterprise? 

a. 5 minutes. 

b. 8 minutes. 

c. 13 minutes.* 

d. 23 minutes. 

7. Monthly bus passes are not valid on which routes? 

8. If you need to transfer to connecting bus service 602, you 
can make the connection at which of the following transfer 
points? 

a. The Justice Complex. 

b. The intersection of West State Street and Warren Street.* 

c. The railroad station. 

d. The intersection of Fairview Avenue and Barlow Street. 



* Denotes correct answer. 
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9. As described in the explanation of how to use the schedule, 
which of the following schedule entries is an example of a 
checkpoint? 

a. President’s Day. 

b. Hanover and Broad.* 

c. Northern New Jersey. 

d. West 6.25. 

10. Give two reasons why a person might want to buy a 
monthly bus pass. 

11. In which of the following situations would you use this bus 
schedule? 

a. You live and work in Pennsylvania. 

b. You are traveling to a party in Trenton on Sunday. 

c. You live in Trenton and work at the Justice Complex.* 

d. You want information about railroad schedules to New 
York City. 

12. Now that you have looked carefully at the bus schedule, use 
your notes and make suggestions to help NJ TRANSIT 
improve this schedule. 



* Denotes correct answer. 
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Scoring Criteria 
Bus Schedule — Grade 8 



2. Explain the most likely reason for scheduling only one bus 
each way between the Goodall Rubber plant and the rail- 
road station. 

Acceptable answers indicate that students recognize the 
Goodall Rubber plant is a work stop and that the bus provides 
workers with transportation to their jobs. 

4. On Friday, the ride from the railroad station to the inter- 
section of Hanover and Broad takes 10 minutes. On Satur- 
day it takes 8 minutes. Why do the schedules differ? 

Acceptable responses suggest a plausible reason that is based 
on accurate information from the bus schedule. 

7. Monthly bus passes are not valid on which routes? 

Acceptable answers indicate all four of the routes identified in 
the bus schedule as not valid with monthly passes. 



10. Give two reasons why a person might want to buy a 
monthly pass. 

Acceptable responses provide two reasons as indicated in the 
bus schedule (such as to avoid needing transfers or exact 
change, or to permit unlimited travel in the zone range). 



12. Now that you have looked carefully at the bus schedule, use 
your notes and make suggestions to help NJ TRANSIT 
improve this schedule. 

Unsatisfactory — These responses demonstrate little or no 
ability to critically evaluate the bus schedule. They contain 
suggestions that are circular, inappropriate, or merely expres- 
sions of a personal opinion about the quality of the schedule. 
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Partial — These responses demonstrate some ability to critically 
evaluate the bus schedule by making one suggestion that clearly 
would improve the bus schedule. Some of these responses 
describe a problem with the schedule in which a suggestion for 
improving it was implied. 

Essential — These responses provide at least two suggestions 
for the bus schedule that would clearly be improvements. The 
suggestions provided in these responses tend to be very specific 
and relate to certain parts of the schedule. 

Extensive — These responses provide at least three suggestions 
for the bus schedule that would clearly be improvements. At 
least one suggestion demonstrates a connection across parts of 
the schedule and represents a more global consideration of the 
schedule than essential-level responses display. 



Note: These scoring criteria are a summary of the more extensive guides used in 
the NAEP scoring. The full guides include examples of student responses for each 
score point. 
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Grade 12 — Reading for Literary Experience 



The death of the hired man 

by Robert Frost 



Mary sat musing on the lamp-flame at the table 
Waiting for Warren. When she heard his step, 

She ran on tip-toe down the darkened passage 
To meet him in the doorway with the news 
And put him on his guard. “Silas is back.” 

She pushed him outward with her through the door 
And shut it after her. “Be kind,” she said. 

She took the market things from Warren’s arms 
And set them on the porch, then drew him down 
To sit beside her on the wooden steps. 

“When was I ever anything but kind to him? 

But I’ll not have the fellow back,” he said. 

“I told him so last haying, didn’t I? 

‘If he left then,’ I said, ‘that ended it.’ 

What good is he? Who else will harbor him 
At his age for the little he can do? 

What help he is there’s no depending on. 

Off he goes always when I need him most. 

‘He thinks he ought to earn a little pay, 

Enough at least to buy tobacco with, 

So he won’t have to beg and be beholden.’ 

‘All right,’ I say, ‘I can’t afford to pay 
Any fixed wages, though I wish I could.’ 

‘Someone else can.’ ‘Then someone else will have to.’ 
I shouldn’t mind his bettering himself 
If that was what it was. You can be certain, 

When he begins like that, there’s someone at him 
Trying to coax him off with pocket-money — 

In haying time, when any help is scarce. 

In winter he comes back to us. I’m done.” 



“Sh! Not so loud: he’ll hear you,” Mary said. 



“I want him to: he’ll have to soon or late.” 



“He’s worn out. He’s asleep beside the stove. 

When I came up from Rowe’s I found him here, 
Huddled against the barn-door fast asleep, 

A miserable sight, and frightening, too — 

You needn’t smile — I didn’t recognize him — 

I wasn’t looking for him— and he’s changed. 

Wait till you see.” 

“Where did you say he’d been?” 

“He didn’t say. I dragged him to the house, 

And gave him tea and tried to make him smoke. 

I tried to make him talk about his travels. 

Nothing would do: he just kept nodding off.” 

“What did he say? Did he say anything?” 

“But little.” 

“Anything? Mary, confess 

He said he’d come to ditch the meadow for me.” 

“Warren!” 

“But did he? I just want to know.” 

“Of course he did. What would you have him say? 
Surely you wouldn’t grudge the poor old man 
Some humble way to save his self-respect. 

He added, if you really care to know, 

He meant to clear the upper pasture, too. 

That sounds like something you have heard before? 
Warren, I wish you could have heard the way 
He jumbled everything. I stopped to look 
Two or three times — he made me feel so queer — 
To see if he was talking in his sleep. 
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He ran on Harold Wilson — you remember — 

The boy you had in haying four years since. 

He’s finished school, and teaching in his college. 

Silas declares you’ll have to get him back. 

He says they two will make a team for work: 

Between them they will lay this farm as smooth! 

The way he mixed that in with other things. 

He thinks young Wilson a likely lad, though daft 
On education — you know how they fought 
All through July under the blazing sun, 

Silas up on the cart to build the load, 

Harold along beside to pitch it on.” 

“Yes, I took care to keep well out of earshot.” 

“Well, those days trouble Silas like a dream. 

You wouldn’t think they would. How some things linger! 
Harold’s young college boy’s assurance piqued him. 

After so many years he still keeps finding 
Good arguments he sees he might have used. 

I sympathize. I know just how it feels 
To think of the right thing to say too late. 

Harold’s associated in his mind with Latin. 

He asked me what I thought of Harold’s saying 
He studied Latin like the violin 
Because he liked it — that an argument! 

He said he couldn’t make the boy believe 
He could find water with a hazel prong — 

Which showed how much good school had ever done him. 
He wanted to go over that. But most of all 
He thinks if he could have another chance 
To teach him how to build a load of hay — ” 

“I know, that’s Silas’ one accomplishment. 

He bundles every forkful in its place, 

And tags and numbers it for future reference, 

So he can find and easily dislodge it 
In the unloading. Silas does that well. 

He takes it out in bunches like big birds’ nests. 




69 



68 



You never see him standing on the hay 
He’s trying to lift, straining to lift himself.” 

“He thinks if he could teach him that, he’d be 
Some good perhaps to someone in the world. 

He hates to see a boy the fool of books. 

Poor Silas, so concerned for other folk, 

And nothing to look backward to with pride, 

And nothing to look forward to with hope, 

So now and never any different.” 

Part of a moon was falling down the west, 

Dragging the whole sky with it to the hills. 

Its light poured softly in her lap. She saw 
And spread her apron to it. She put out her hand 
Among the harp-like morning-glory strings, 

Taut with the dew from garden bed to eaves, 

As if she played unheard the tenderness 
That Wrought on him beside her in the night. 
“Warren,” she said, “he has come home to die: 

You needn’t be afraid he’ll leave you this time.” 

“Home,” he mocked gently. 

“Yes, what else but home? 

It all depends on what you mean by home. 

Of course he’s nothing to us, any more 
Than was the hound that came a stranger to us 
Out of the woods, worn out upon the trail.” 

“Home is the place where, when you have to go there, 
They have to take you in.” 

“I should have called it 

Something you somehow haven’t to deserve.” 

Warren leaned out and took a step or two, 

Picked up a little stick, and brought it back 
And broke it in his hand and tossed it by. 
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“Silas has better claim on us, you think, 

Than on his brother? Thirteen little miles 
As the road winds would bring him to his door. 

Silas has walked that far no doubt today. 

Why didn’t he go there? His brother’s rich, 

A somebody — director in the bank.” 

“He never told us that.” 

“We know it though.” 

“I think his brother ought to help, of course. 

I’ll see to that if there is need. He ought of right 
To take him in, and might be willing to — 

He may be better than appearances. 

But have some pity on Silas. Do you think 
if he’d had any pride in claiming kin 
Or anything he looked for from his brother, 

He’d keep so still about him all this time?” 

“I wonder what’s between them.” 

“I can tell you. 

Silas is what he is — we wouldn’t mind him — 

But just the kind that kinsfolk can’t abide. 

He never did a thing so very bad. 

He don’t know why he isn’t quite as good 
As anyone. He won’t be made ashamed 
To please his brother, worthless though he is.” 

“I can’t think Si ever hurt anyone.” 

“No, but he hurt my heart the way he lay 

And rolled his old head on that sharp-edged chair-back. 

He wouldn’t let me put him on the lounge. 

You must go in and see what you can do. 

I made the bed up for him there tonight. 

You’ll be surprised at him — how much he’s broken. 

His working days are done; I’m sure of it.” 
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“I’d not be in a hurry to say that.” 

“I haven’t been. Go, look, see for yourself. 

But, Warren, please remember how it is: 

He’s come to help you ditch the meadow. 

He has a plan. You mustn’t laugh at him. 

He may not speak of it, and then he may. 

I’ll sit and see if that small sailing cloud 
Will hit or miss the moon.” 

It hit the moon. 

Then there were three there, making a dim row, 
The moon, the little silver cloud, and she. 

Warren returned — too soon, it seemed to her, 
Slipped to her side, caught up her hand and waited. 

“Warren,” she questioned. 

“Dead,” was all he answered. 



From The Poetry of Robert Frost, edited by Edward Connery Lathem. Copyright 
1928, 1969 by Holt, Rinehart and Winston. Copyright 1956 by Robert Frost. 
Reprinted with permission from Henry Holt and Company, Inc. 
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“The death of the hired man” 
Sample Questions — Grade 12 



1. Mary does not criticize Silas’ offer to help on the farm the 
way Warren does because 

a. she knows Silas is only attempting to save his self-respect.* 

b. she believes that Warren really needs his help with haying. 

c. she wants Silas to please his brother. 

d. she does not want Silas to think she is rude. 

2. What are two types of relationships that Robert Frost 
explored in the poem? 

3. Mary meets Warren at the door and tells him that Silas is 
back so that 

a. they can go to the market for some tobacco. 

b. Warren can count on Silas’ help to ditch the meadow. 

c. they can call Silas’ brother to pick Silas up. 

d. Warren will be careful about what he said.* 

4. Warren defined “home” as “the place where, when you 
have to go there, They have to take you in.” Explain why 
you agree or disagree with Warren. 

5. Why does Mary listen to Warren complain about Silas? 



* Denotes correct answer. 
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6. What is really bothering Warren about Silas’ return? 

a. He does not have the money to pay Silas’ salary. 

b. He does not like to get in arguments with Silas. 

c. He believes Silas will leave again.* 

d. Silas does not work hard enough to suit him. 

7. What kind of relationship did Silas have with his brother? 

8. How did Silas view formal education? 

a. He said it was necessary in order to be self-assured. 

b. He valued it as a way to leam farming. 

c. He thought it was impractical and a waste of time.* 

d. He felt it caused people to argue too much. 

9. From your experience, do you think that most people would 
do what Mary did for Silas? Explain why or why not. 

10. How does Robert Frost use the relationship between Mary 
and Warren to help explain the character of Mary? Sup- 
port your answer with evidence from the poem. 

11. What does Warren mean when he says, “I’m done”? 

12. What does Mary mean when she says that home is 
“Something you somehow haven’t to deserve”? 

a. You have to work hard to be part of a family. 

b. It is a place where people merely tolerate you. 

c. You do not have to be related to someone to be accepted. 

d. It is something you do not have to earn.* 

* Denotes correct answer. 




ERIC 



74 



“The death of the hired man” 
Scoring Criteria — Grade 12 



2. What are two types of relationships that Robert Frost 
explored in this poem? 

Acceptable responses mention any two relationships that are 
described explicitly or implicitly in the poem (such as husband 
and wife, worker and boss, young and old, etc.) 

4. Warren defined “home” as “the place where, when you 
have to go there, They have to take you in.” Explain why 
you agree or disagree with Warren. 

Acceptable answers provide an opinion and an explanation of 
why that opinion is held, or an explanation from which an 
opinion can be readily inferred. The explanation must be 
noncircular and reflect an understanding of Warren’s statement. 

5. Why does Mary listen to Warren complain about Silas? 

Acceptable responses provide an answer that refers to Mary’s 
character and indicate her motivation to help Silas or her 
respect for Warren. 

7. What kind of relationship did Silas have with his brother? 

Acceptable responses appropriately describe the relationship as 
being distant or broken, or include some other description that 
reflects understanding of the lack of a close or supportive 
relationship between the two brothers. 

9. From your experience, do you think that most people would 
do what Mary did for Silas? Explain why or why not. 

Acceptable answers provide an opinion that is supported by 
something from the student’s experience. The answer also must 
correctly state or imply that Mary tried to understand Silas’ 
behavior or to see things from his perspective. 
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10. How does Robert Frost use the relationship between Mary 
and Warren to help explain the character of Mary? Sup- 
port your answer with evidence from the poem. 

Unsatisfactory — These responses provide inappropriate or 
inaccurate information about Mary’s character and/or the 
relationship. They demonstrate little or no understanding of 
Warren and Mary’s relationship within the poem and no ability 
to objectively consider the poet’s use of the relationship in the 
poem. 

Partial — These responses demonstrate some understanding of 
the character of Mary or the relationship between Mary and 
Warren. However, they do not provide evidence from the poem 
to establish a connection between the relationship and the 
poet’s portrayal of Mary’s character. 

Essential — These responses demonstrate understanding of both 
Mary’s character and the relationship between Warren and 
Mary. In addition, they make some connection between this 
relationship and the poet’s portrayal of Mary’s character by 
using evidence from the poem. This connection, however, is 
usually limited to describing how Mary’s character is exposed 
during the interactions between Warren and Mary. 

Extensive — These responses move beyond simply describing 
Mary’s character within the relationship to focusing on how the 
poet intentionally used their relationship in several parts of the 
poem to portray Mary in a particular light. Responses at this 
level demonstrate a clear critical stance by being explicit about 
their consideration of the poet’s techniques and purposes as 
well as providing appropriate evidence from the poem. 

11. What does Warren mean when he says, “I’m done”? 

Acceptable answers indicate that Warren meant that he was 
finished helping or tolerating Silas or that he was not going to 
let Silas return to the farm. 



Note: These scoring criteria are a summary of the more extensive guides used in 
the NAEP scoring. The full guides include examples of student responses for each 
score point. 
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